Towards Ultra-Resolution Neural Style Transfer via Thumbnail Instance Normalization
نویسندگان
چکیده
We present an extremely simple Ultra-Resolution Style Transfer framework, termed URST, to flexibly process arbitrary high-resolution images (e.g., 10000x10000 pixels) style transfer for the first time. Most of existing state-of-the-art methods would fall short due massive memory cost and small stroke size when processing ultra-high resolution images. URST completely avoids problem caused by (1) dividing image into patches (2) performing patch-wise with a novel Thumbnail Instance Normalization (TIN). Specifically, TIN can extract thumbnail features' normalization statistics apply them patches, ensuring consistency among different patches. Overall, framework has three merits compared prior arts. divide input adopt TIN, successfully transferring high-resolution. Experiments show that our surpasses SOTA on benefiting from effectiveness proposed perceptual loss in enlarging size. (3) Our be easily plugged most directly improve their performance even without training. Code is available at https://git.io/URST.
منابع مشابه
Towards Metamerism via Foveated Style Transfer
Given the recent successes of deep learning applied to style transfer and texture synthesis, we propose a new theoretical framework to construct visual metamers: a family of perceptually identical, yet physically different images. We review work both in neuroscience related to metameric stimuli, as well as computer vision research in style transfer. We propose our NeuroFovea metamer model that ...
متن کاملSupplementary Materials: Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
In Fig. 1 we show the content and style loss in training and test set. The training loss is post-processed with median filtering of window size 2000 and the test loss is computed every 2000 iterations. We did not observe much overfitting: the training and test loss trend are almost the same. We conjecture that the task is so difficult that the network with millions of parameters still underfit....
متن کاملStereoscopic Neural Style Transfer
This paper presents the first attempt at stereoscopic neural style transfer, which responds to the emerging demand for 3D movies or AR/VR. We start with a careful examination of applying existing monocular style transfer methods to left and right views of stereoscopic images separately. This reveals that the original disparity consistency cannot be well preserved in the final stylization result...
متن کاملDemystifying Neural Style Transfer
Neural Style Transfer [Gatys et al., 2016] has recently demonstrated very exciting results which catches eyes in both academia and industry. Despite the amazing results, the principle of neural style transfer, especially why the Gram matrices could represent style remains unclear. In this paper, we propose a novel interpretation of neural style transfer by treating it as a domain adaptation pro...
متن کاملNeural Style Transfer Replication Project
There are three major advancements in the area of neural style transfer. In 2015, the paper, A neural algorithm of artistic style [2], proposes an iterative algorithm for neural style transfer. In 2016, the paper, Perceptual losses for real-time style transfer and super-resolution [3], proposes a real-time neural style transfer algorithm. However, for this algorithm, we have to train a seperate...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2022
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v36i1.19916